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ABSTRACT 

This paper begins with a brief review of research 
trends in the area of organization and memory. A discussion in them 
presented their relevance to the study of children’s processing 
abilities, and the suggestion is presented of a possible useful tool 
in the application of knowledge about information processing to the 
educational experience of the child. While the author’s major 
interest is in the field of learning in handicapped children, it is 
suggested that young normal children may also benefit from such 
applications. The measurement tool described is The Sampling 
Organizational and Recall Through Strategies (S.O.R.T.S.) test. It 
has been designed to diagnose specific levels of spontaneous grouping 
strategy generation in such a way as to predict an appropriate 
educational intervention to enhance the use of conceptual strategies. 
The procedure for administering and scoring the test is described, in 
addition to a discussion of test interpretation. (BW/Author) 
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Measuring Children's Organizational Strategies 
by Sampling Overt Groupings. 

R. Hunt Rlegel 
University of Minnesota 

Many inferences derived from adult studies about children's 
memory abilities have been based on assunptions of quantitative 
differences due to age. A developmental perspective, however, in- 
cludes qualitative differences as well, and should be considered 
more carefully if applied researchers are to make educationally 
relevant recommendations regarding school curricula. In this 
paper we shall briefly review research trends in the area of 
organization and memory, discuss their relevance to the study of 
children's processing abilities, and suggest a possibly useful 
tool in the application of knowledge about information processing 
to the educational experience of the chili. While this writer's 
major interest is in the field of learning in handicapped children, 
it is suggested that young normal children may also benefit 
from such applications. 

In the field of information processing, a great deal has been 
written regarding the optimal amount of information manageable at a 
given time for the purposes of storage. Limits on adult processing 
abilities have been specified (Miller, 1956) and refined (Handler, 
1967) to suggest that some form of organizational strategy must be 
activated in order to overcome the demands made on memory by large 
amounts of information. Kinds of activities related to retention and 
recall too, have been studied (Tulving, 1968), in which primary and 
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secondary organization of information has been discussed. Typically, 
these studies have involved adult subjects, and the factors dis- 
cussed have celated to the relationship between experimenter-imposed 
material and the subject’s recall. 

t' 1 One other variable related to recall which has received much 

attention recently is the variable described as "clustering” by 
Bousfield (1)53). In studies related to this phenomenon recall 
protocols have been analysed to determine the consistency with which 
items recalled appear adjacent to each otter over trials. Again, 
the majority of these studies have been ccnducted with adult subjects, 
with generalizations made regarding the nature of memory failing to 
take into account possible qualitative developmental differences. 
Modification? of the clustering studies for use with children have 
been made (c:. Stephens, 1964), but they continue to emphasize 
recall variables only, holding input presentation constant or under 
the careful control of the experimenter. It seems to this writer 
that the study of organizational factors related to learning and 
retention in children must encompass both developmental trends in 
organizational processes at input and organizational factors at 
recall. Further, if educationally relevant recommendations are to be 
made, the relationship between input and output variables must be 
better specified. To this end, the study of organizational processing 
in children, particularly as it relates to conceptual behavior, must 
be taken into account. To restrict the study of memory and recall- 
related factors to adult subjects who have already developed organi- 
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zationa! schemes for processing information is to ignore the nature 
of the means by which those schemes developed, and limits our ability 
to apply knowledge about information processing to learning in the 
formal educational process. 

Much evidence has been presented which suggests that children's 
organizational schemes differ qualitatively from one developmental 
stage to the next (cf . , Inhelder & Piaget, 1959; Kuhn, 1972), and 
that the kirds of operations observed at a given time may be analyzed 
in terms of the underlying conceptual level determining their form. 
Generally these schemes are seen to change from perceptually deter- 
mined collections of items to hierarchical groupings. From an Infor- 
mation reduction point of view (as espoused by Miller and Handler) 
these qualitative changes may be seen as progressing toward higher 
competence in both organizational effectiveness and related output 
(recall) efficiency. Unfortunately, studies related to the identi- 
fication of organizational schemes in children have typically focussed 
on the type of relations found by children in a set of experimenter- 
imposed groups. Like the adult studies of recall, and like the mod- 
ifications of those studies with children, studies of organizational 
schemes have been limited to only one aspect of the learning for 
retention process. For example, Bruner and Olver (1963) have obtained 
a wealth of data regarding age differences in the kinds of relations 
found between sets of experimenter-imposed items, but have stopped 
short of collecting recall data relevant to those relations. Kuhn 
(1972), too, has substantiated in part the stages of grouping behavior 
specified by Inhelder & Piage (1959), again without pursuing the 
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question of the effects of the differing grouping schemes on recall . 
It seems to this writer that such studies, while providing valuable 
information specific to the questions the/ are asking, tend to suffer 
from laboratory 'rigiditis* in that they consistently fail to 
associate input factors (e.g., classificatory behavior, grouping 
strategies, transformations) and output f ictors (e.g., clustering, 
total recall). We would suggest that the two may be related in 
operational terms. But before turning to this writer's suggested 
solution to the above problem, let us briefly consider the learning 
problems of the young mentally retarded child. 

By the age of six years, children en zering the mainstream of 
education are exposed to a wide variety o' activities in which infor- 
mation processing and remembering are essential. Often, however, 
children of this age group have not fully developed cognitive abil- 
ities which are precursors to efficient processing skills. For 
example, the ability to decenter or attend to associations between 
several stimuli simultaneously is often not fully developed. Many 
young children will tend to "center" or attend to only one attribute 
of a single stimulus, and to be attracted more by perceptual charac- 
teristics of items than to intrinsic or more functional dimensions 
(cf. Bruner & Olver, 1963). Functional awareness of their own 
thought processes, too, is still unavailable for planful learning in 
most young children (cf. Flavell, Friedrichs & Hoyt, 1970), although 
there is evidence from several sources that young children do in 
fact utilize some form of organization, albeit inefficient, in pro- 
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cessing n sc of stimuli (Rossi & Rossi, 1965; Moely, c_t aK » 1969). 
The kinds of difficulties mentioned above appear to be even more 
extensive i.» children identified as mentally retarded. 

Retardei children have frequently been described as inefficient 
learners, although there is evidence that associations, once formed, 
tend to be f lirly durable in these as well as normal children (cf. 
Baumeister, 1967). Indeed, recall of itens from short term memory 
seems to be vithin normal ranges for underachievers (cf. Murakawa & 
Picrce-Jones , 1969). The problems encountered by the retarded are 
most frequently associated with acquisiticn phases of learning, and 
have been reLated to inefficient learning habits (Osborn, 1960; Iano , 
1971) or to roor conceptual skills (Stephens, 1966). Studies investi- 
gating the kinds of associations retarded children generate have con- 
sistently sh rwn that they identify and use fewer functional relations 
or more perceptually-based groupings (cf., Stephens, 1966; Stacey & 
Portnoy, 1951; Spitz, 1966). If such findings are to be related to 
improving educational practices, instruments must be developed to 
accurately diagnose the kinds of strategies EMR children employ 
during acquisition, and to suggest possible intervention programs for 
improving those strategies. 

One such measure is described here. The Sampling Organization 
and Recall through Strategies (S.O.R.T.S.) test has been designed 
to diagnose specific levels of spontaneous grouping strategy gen- 
eration in such a way as to predict an appropriate educational inter- 
vention to enhance the use of conceptual strategies. 
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There arc several factors which must be taken into account in 
the development of an instrument for assessing the organizational 
abilities of young children. The measure should allow for spon- 
taneity on the part of the subject in selecting grouping strategics. 
The measure should allow for young children's unfamiliarity with 
written symbols. A variety of strategies should be tapped in 
determining the relative ability of a child to group a list of 
items. Thu? items should have the capacity for being grouped along 
a variety o 4 dimensions. The child should be given an opportunity 
to understand what is expected of him before definitive statements 
can be made regarding his ability to generate grouping strategies. 

The effects of rote rehearsal should be minimized if grouping 
strategies are to be meaningfully related to recall data. And 
the effects of novelty of the items on the measure should be mini- 
mized, so that confounding recall with degree of original learning 
may be avoided. 

With these factors in mind, the construction of the instrument 
has taken the following form: (1) Items selected for the test 

were common animate and inanimate objects for which the child was 
likely to supply a name. (2) Items were to be presented pictor- 
ially to avoid children’s inability to read their names. (3) Items 
have the capacity for a wide variety of associations as well as 
"straight” categorical relations. (4) A perceptual dimension 
independent of the item itself was needed to allow for sorting along 
a color dimension which would not be confounded with other, higher- 
level sorts. (5) The total number of items in sorts requiring recall 
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had to ho large* enough to avoid ceiling e fccts* yet small enough 
not to overwhelm the subjects. (6) Instructions were needed which 
would avoid any cues or reinforcements f o ' particular kinds of sorts, 
so that subjects would be encouraged to generate his own groups. The 
test, when constructed with these factors in mind, has thus taken the 
following form: 

1. Administration instructions have been developed which staiv- 
dardize procedures related to stimulus presentation and which specify 
standard prompting procedures for minimizing unintentional cueing 
(See Appendix A. ) . 

2. Specific directions for the test, in the form of verbatim 
instructions for the subject and procedural instructions for the 
examiner, have been developed for adminis irative standardization 
(See Appendix £.). 

3. A scoring sheet has been developed for rapid scoring of 
grouping responses and in which specific information related to 
the child's sorting performance may be readily recorded (See 
Appendix C.). 

As is evident from the appendices, the test is composed of four 
distinct parts. In the first, the child is asked simply to put 
pictures together the way he thinks is best, and to give his reasons 
for the groups. The instructions are open-ended with the aim of 
eliciting a relatively pure estimation of what the child does spon- 
taneously in such a situation. The second part is a repetition of 
the first, but with explicit instructions to search for similarities 
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between the items. These first two sorts contain only 12 items, 
and serve net only as diagnostic measures but also as warm-up 
activities to the more important sort 3. No recall is required, 
and childrer seem quite willing to attempt to organize this small 
set. The tl ird part, however, does require recall, and so includes 
?0 items. In this sort, the items are changed from animals to 
common inanimate objects which are known :o most children. This 
shift, along with altering the spatial array of the items at pre- 
sentation, is intended to reduce the possibility of interference 
of the first sorts on the recall of the tiird. Following his 
grouping anc a recall period, the subject is again asked his reasons 
for the particular groups he made. The fourth part of the test is 
intended foi administration only aftex* the child has made his own 
groups and recalled from them. In this part, the experimenter 
arranges the 20 pictures used in the third sort into the categories 
specified on the scoresheet (i.e., things that grow, things that 
make noise/music, furniture, transportation, things to live in). 

He then asks the subject to give the reasons he thinks are appro- 
priate to the groups formed, and again asks for recall. Typically 
this fourth part has been used only in posttesting in the studies 
we have run, in order to avoid contaminating the spontaneous gener- 
ation of groups in earlier sorts. If used as a diagnostic instru- 
ment, however, this part should be included in all cases. 

In the course of administration, data is collected in the 
following categories: 
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1) the actual groups formed by Lhe s ibjeo w 

2) the subject’s verbalized reasons Cor each group he formed. 

3) the experimenter’s judgment of whit the child was doing 
(should 1 and 2 above be discrepant) , and comments regarding un- 
usual events during testing. 

4) the verbatim protocol during recaLl in Sorts 3 and 4. 

5) the subjects’ reasons generated fir categories formed by 
the experimenter in Sort 4. 

In addition to these ’’hard data” indices, recalled items are then 
coded according to the groups they were i i during the sorting 
phase, which will then yield an index of clustering, to be dis- 
cussed below. 

Scoring tbe test : 

An extensive review of previous literature concerned with con- 
ceptual development and developmental sorting differences (see 
above), and much field observation, have led the writer to a five- 
point scoring system which describes the relative level of grouping 
strategy employed by young children. Specific scoring criteria 
are reproduced in Appendix D, and describe the kinds of sorts likely 
to occur, rather than implying values. While it has been found that 
levels 1 and 2 sorts (syncretic and perceptual) have consistently 
been related to underachievers, retarded, or very young children, 
all higher-level associative responses should be devoid of implied 
judgmental value. Idiosyncratic associations, for example, may be 
quite different from conventional categorical sorts, yet may have 




10 



10 



great mcdiat Lonal value for the individual. Indeed, several 
writers have r vt j o.u'd against the fallacious belief that conven- 
tional categories are '’better" than elaborative contexts or other 
kinds of rich mediational strategies (cf. Bussis & Chittenden, 1970). 

There are basically three scores which are derived for the 
purpose of describing the child's performance: 

(1) the sort level obtained by means of a weighted average 
of items grouped in particular ways. This index is obtained for 
each of the four sorts in the test. The Level assigned to sort 4 S 
however, is based primarily on the subjecz’s reasons for the groups, 
since he is not asked to sort the cards i:i this part. 

(2) the actual correct recall of it Jins in Sorts 3 and 4, ob- 
tained by simple counting. 

(3) an index of clustering, providing a measure of the extent 
to which recall protocols correspond to the organization present 
during input. Thus, in Sort 3, the clustering index is derived by 
comparison of recall order v?ith the groups the child made. On Sort 4, 
the index is derived by comparing the recall order with the experi- 
menter’s groups . A description and rationale for the clustering 

index chosen will be provided below, in the section entitled "clustering". 
While these three scores comprise the major informational data for 
analysis, there are several other factors which are available for 
study. For example, the total number of groups represented at 
recall and the average number of words per group at recall are two 
such factors. For our purposes here, however, we shall limit our 
discussion to the three major data sources. 
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1. The weighted average. 

In order to assess the way in which a child approaches 
the problem of sorting an entire array of pictures, an index was 
developed which would reflect in a single score both the extent to 
which all items were considered and the relative extent to which 
inclusion and exclusion rules were used. To this end, a weighted 
average based on the number of items grouped at each level was devised. 
The number cf pictures the child placed into each group was weighted 
by the number assigned to the kind of group he formed, according to the 
specifications in Appendix D. An average score for the entire array 
was then taken by dividing the sum of the individual group scores by 
the total number of items in the array. The formula used was 

S = £ ( N j* L j^ w h e re S is the subject’s sortxng score, N is the total 

number of items presented, N.. is the number of items in each group, 
and L is the weight specific to each of the j groups. This index, 
while losing information about specific groups made, has the advantage 
of providing a general summary of the child’s relative proximity to 
efficient information-reduction groupings. 

2. Recall 

Specific items recalled were assigned index markers corresponding 
to the groups made by the child. These indices were used in an analysis 
of runs, which constitutes the basis for the clustering score described 
in the next section. Total recall was counted, ignoring repetitions. 
Intrusions were treated separately. Analyses of recall were made both 
in terms of group means and by frequency counts of subjects recalling 
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more, than eight items correctly, those recalling less than four, 
and subjects recalling between four and eight items. These ranges 
are based on the short term memory expect*- tions defined by Miller 
(1956), modified to account for the slightly smaller recall scores 
(Nelson, 1969 ) observed in young retarded children. Thus frequency 
analyses of recall data were made around the expected short term 
memory range of 6+2. 

3. The Clustering Index. 

This index, based on runs theory for which statistics have been 
developed (Mood, 1940) and modified (Wallis & Roberts, 1957), has 
been adapted for use with recall data by Irankel and Cole (1971). 

Their paper presents a thorough analysis cf the various clustering 
indices in use, and is recommended for readers interested in this 
aspect of organizational analysis. Basically, the index derived is 
a 2 - score representing the difference between the observed number 
of runs of items from j categories and the mean number of runs 
occurring by chance in a list length of N items with J categories 
represented, divided by the square root of the variance of the number 
of runs observed. The formulae used to derive this score may be found 
in Frankel & Cole’s paper, but are reproduced here for the reader’s 
information : 

g — Q r _ Mj- 

, where Or is the observed number of runs in a given 

Jvr 

recalled list, Mr is the mean of the normally distributed number of 

2 

runs for list length N, derived by the formula Mr = N(N+1) -£.N 

J J * 

N 
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and Vr is the variance of the observed number of runs, calculated 

by the formula Vr = Z . [7. .N ,+N(N+l) 1 - 2ME N 3 -N 3 

J J J j j 

_ • 

N 2 (N-1) 

The benefits of this statistic derive from the fact that it accounts 
for chance runs in the recall protocol, and is independent of the list 
length it is used to explain. 

With this background in mind, we tun. now to two studies conducted 
by the writer and his colleagues in the Research, Development and 
Demonstration Center for the Education of Handicapped Children at the 
University of Minnesota. Both studies in\ olved the use of S.O.R.T.S. as 
a dependent /ariable in the training of young handicapped children 
to generate ind utilize more efficient, planful strategies for organizing 
materials. \ sequence of training activi ies was developed in which 
skills necessary to the successful utilization of a grouping strategy 
were systematically taught to the subjects over a month’s time. Pre- 
and post- test analyses were conducted, and change scores were 
evaluated. The following is t summary of these projects. 

Study 1: The St. Paul strategies instructional program 

During the summer of 1971 a project was conducted in St. Paul, 
Minnesota under Title I funding, in which 2MR children identified as 
at least one year below expectation in reading and/or math achieve- 
ment were provided a program of basic academic training (Riegel & 

Taylor, 1971). A second component of this project was the develop- 
ment and pilot use of a mnemonic strategies approach to teaching 
organizational skills. A sequence of activities was developed for use 
with the youngest third of this population, and the S.O.R.T.S. test 
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Method 

Children were pretested on the S.O.ll.T.S. test in late June 
and posttested in late July, 1971. In tie interim, activities xvere 
developed and piloted which were designee' to improve the child's 
awareness and use of strategies for seeking relations and organizing 
sets of stimuli. The tests were individially administered by a group 
of trained testers. The results were then scored by the writer. A 
second scorer rescored a later set of data, resulting in an inter- 
rater reliability on the scoring key (Appendix D) of .94, .89, and 
.90 for sorts 1-3 respectively. Repeated measures t-tests (Ferguson, 
1971) were run to assess the change in overall grouping level over 
the one month training period. While the "e were no control subjects 
available for this study. Study 2 includes such a group for comparison. 

Results 

Table 1 summarizes the mean pretest and posttest sorting data 

for the sample, with repeated measures t-test results indicating the 

® ■^■8^^- f i cance of the change over one month. As may be seen, the group 

changed significantly in the direction of using more associative 

relations in grouping the items (p < .01 in all three sorts). Because 
of the nature of the training, we expected a shift in this direction, 

and so a one-tailed test of significance was used. In this case and 

other repeated measures t-tests for this sample, N-l degrees of 

freedom were 28, where N is the number of pairs of observation. While 

the average sorting level increased only about .5 levels on the post- 

test, this shift indicates that significantly more items were associated 
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meaningful 1 / by the children than on the pretest. 



Insert Table 1 here 



Because specific information regarding the kind of sorts obtained 
is lost tli lough combination of the weighted averages over the entire 
sample, frecuencies of responses at each of three levels of organiza- 
tion are reported in Table 2. Intervals >f scores in this table 
correspond to sorts which are primarily svncretic in nature (A), 
perceptual (B) or associative (C) , indica;ing a trend from no apparent 
strategy for grouping to more planful rules for associating items. 



Insert Table 2 about here 



As may be seen, in the first two sorts, there is a distinct trend 
from perceptual sorts toward more associative groupings, with seven 
children more falling in the associative range at posttest. On sort 
3, in which the array is significantly larger, the shift is more 
from a failure to generate an effective grouping strategy on the 
pretest to sorting at least by perceptual attribute on the posttest, 
no fewer than 10 children demonstrating this gain. A graphic repre- 
sentation of these shifts is provided in the histogram in Figure 1. 



Insert Figure 1 here 
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It is evident from these data that the children in this sample 
shifted toward more functional levels of grouping* strategies. The 
recall data shows a corresponding increase in both quantity and 
clustering quality on the posttest. Given the range of 6j-2 discussed 
earlier as an expected short term store for individual items, we 
shall present here the frequencies of children falling either within 
or beyond the limit of 8 items defined by this range. Table 3 pre- 
sents these frequencies in terms of total number of items recalled 
correctly or both the pretest and the posttest. The increase of 11 
children recalling 9 or more items is a sound indication that indeed 

the childrer were recalling more effectively following the training 
period. 



Insert Table 3 about here 



The means, standard deviations and significance of these data are 
summarized in Table 4. A difference of nearly two items recalled on 
the posttest produces a t of 3.012, significant beyond the .005 level 
on a one-tailed test with 28 degrees of freedom. On the pretest it 
may be seen that on the average the children were recalling within 
the limit postulated for short term store, while the posttest data 
indicate an average recall beyond that limit. Thus the shift toward 
more effective strategies is readily evident in the recall data. 



Insert Table 4 about here 
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Clustering of items at recall, too, reflects this shift toward more 
efficient strategies on the part of the children in the sample, 
although these data are less dramatic than either the sorting or the 
recall data. Taking a Z-score of 1.96 as an indication of significant 
clustering beyond the .05 level, Table 5 summarizes the number of 
children falling above and below this lev-1 . While only 3 children 
changed in the significance of clustering, a trend toward this index 
of the use cf grouping as a mnemonic strategy may be seen more clearly 
in the next study, in which the direct association between the grouping 
operation and remembering was made more e:qilicit. 



Insert Table 5 about here 



Study 2: The Roseville project. 

Subjects 

This study, in part a replication of the training sequence study 
described in Study 1, comprised two "transition" classes of childrer 
judged not ready for successful first grade placement. Twenty-nine 
children were included, but one subject was dropped from the sample 
due to extreme hyperactivity and behavioral disorders. The mean age 
of the sample was 78 months, with a standard deviation of 2.7. The 
mean I.Q. was 100.5, with a standard deviation of 9.4. This sample 
is younger than that of the previous study, although there is little 
difference in the average mental age of the two samples ( the li.A. in 

n 

O 
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months of tl e Study 2 sample being 78 months, and that of Study 1 
being 77 norths.) 

Subjects were randomly assigned within schools to each of two 
conditions. The experimental groups received training in grouping 
strategies for 1/2 hour daily for 4 weeks. The control group was 
given training in art techniques for a comparable amount of time. 
Pretesting consisted of the first three sorts of the SORTS test, 

while posttesting included all four parts This study included the 
first use of the fourth sort in an experimental situation. 

Results 

The resalts of pretest and posttest cata collected for the two 
groups are summarized in Table 6. Similarities may be seen between 
the trend indicated by these data and those of Study 1. The experimental 
group showed a distinct shift (again of approximately .5 levels) 
toward more associative groupings, while the control group showed no 
such change. Repeated measures t tests indicate significant change 
for the experimental group beyond the .05 level on all three sorts 
on one-Lailed tests with 13 degrees of freedom (N-l = 13 where N is 
the number of paired observations). 



Insert Table 6 about here 



Table 7 presents a frequency of occurance summary of subjects sorting 
at syncretic (A), perceptual (B) and associative (C) levels. The 
trend reflected in the above scores is readily evident in the change 




20 



20 



in numbers of children sorting at higher levels for the experimental 
condition, particularly in sorts 1 and 3, in which four subjects 
moved toward associative grouping from syncretic and perceptual 

levels on the pretest, while no such shift is seen for the control 
subjects . 



Insert Table 7 about here 



In general, it may be said that a proportionately higher number of 
the experimental group were using associative strategies on the post 
test than were the control subjects. 

The recall data, too, reflects this shift, but in this case the 
differences In mean scores are not as striking. On the pretest, the 
control subjects recalled an average of 5.97 items, while the experi- 
mental subjects recalled nearly one item fewer (with a mean of 5.0). 

On the posttest, both groups recalled the same mean number of items 
(6.6). The differences between the groups is evident in their change 
scores, however, with a repeated measures t for the control group of 
0.785 (p < . 50) , and the experimental group of 2.126 (p <.05). Al- 
though subjects were randomly assigned to treatments, it was discovered 
after the training had begun that r disproportionate number of experi- 
mental subjects were rated as impulsive on the MFF scale (Kagan, 1965). 
While only 2 of the 14 control subjects were classified as impulsive, 
no fewer than 7 of the experimental group were so classified. We 
take this apparent difference in the groups at pretest to be a partial 
explanation of the pretest recall differences observed. 
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Rp.H differences between the groups appear in the breakdown of 
recall data into subjects recalling more than 8 items, however. 

Table. 8 pre,ents these data, in which it may be seen that, while 
there was na change in the number of control subjects recalling more 
than the hy .othcsizcd short term limit (there being 3 on both testings 
there is a hange of six subjects falling in the upper group from 
the experimental sample. 



Insert Table 8 about iere 



The nunber of children clustering significantly at recall 
corresponds to this shift, as summarized ;.n Table 9. While only 
one control subject changed in the signif: cance with which his recall 
corresponded to the groups he made on sort. 3, four of the experimental 
subjects showed this shift. This difference provides support for the 
notion that at least some of the experimental group were learning 
to use grouping strategies more effectively for remembering. 



Insert Table 9 about here 



These data, when c. . ared with those o'. Study 2, lend strong support 
to the hypothesis that there are systematic changes occurring on 
the S.G.R.T.S. test in response to training young children to generate 
and use grouping strategies. One further part of the test should 
now be considered ; tb fourth sort, in which children were asked to 
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discover reasons for and recall items from groups imposed by the 
experimenter, was administered to both groups at the time of post- 
testing. The number of children identifying associative or cate- 
gorical relations for the imposed groups was markedly different for 
the two groups, as indicated in Table 10. In the control group, 
there was a tendency to either discover no associative relation at 
all or to identify the conventional category represented by the 
items. In :he experimental group, however, there was a wider range 
of responses indicating associative relations, and far fewer subjects 
who could nc-t identify any functional relations at all (there being 
only one such subject in this group, and seven in the control group. 



Insert Table 10 about here 



Differences in the recall averages for each group were larger 
than those in sort 3, with the experimental group recalling an 
average of 1.36 items more than the control subjects. The mean 
recall ox the experimental group was 7.64, while the mean of the 
control group was 6.28. This increase from sort 3 to sort 4 in 
recall reflects a generally increased ability on the part of the 
experimental group to utilize organization provided by an external 
source. A relationship between the subjects* recall and the clustering 
observed becomes apparent at this point. Six of the 14 experimental 
subjects recalled 9 or more items from sort 4, while only three of 
the control subjects recalled in this range. Of the six experimental 
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subjects, five clustered significantly, while none of the control 
subjects used the groups provided by the experimenter as signifi- 
cant mnemonic mediators. Table 11 summarizes the mean recall and 
frequencies of clustering for the two groups. 



Insert Table 11 about here 



Discussion 

The studies reported here are exploratory. Our questions 
relate to the efficacy of a test for measuring childrens' organi- 
zational strategies. While it is suggested that the instrument 
described is appropriate for the assessment of organizational changes 
in young children, the training sequence developed for these two 
studies is but one possible package. In it, the processes involved 
m the generation of a grouping strategy have been specificed and 
developed into a sequential progression of processing skills (this 
sequence of activities is available from the writer, at the address 
listed on the title page of this paper). Answers to questions re- 
lated to changes in information processing skills in children are 

sought through the S.O.R.T.S. test in terms of both qualitative and 
quantitative indices. 

The data reported above reflect the scores obtained on the S.O.R.T.S. 
test prior to and immediately following a sequence of training activities 
constructed on the same model. The two studies reported above con- 
stitute pilot studies of both the test and the training sequence. As 
such, it is difficult to make definitive statements about the test 
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due to the small sample sizes in each study. However, there 
are strong indications that the children in the samples were per- 
forming better in both organizational grouping and recall following 
training. Although much data is lost by using a weighted average, 
it is evidert that children given organizational training in both 
studies inci eased significantly in their use of more associative 
kinds of strategies (producing a .5 increase in the mean weighted 
average for both studies) . Because the descriptive data fell into 

groups of scores which were too small for appropriate nonparametrie 

2 

statistical analyses (e.g. - y ) , we have reported mainly frequency 
tables. Further studies of the ««_.asure currently in progress are 
using larger samples, and will be more general izeab le . However, 
even from the small data base available, :.t is apparent that 
significant numbers of children are recalling more and grouping 
more efficiently after even a month of training. It is clear to 
this writer that the test is a useful one, which is sensitive to 
the assessment of operational schemes generated by young subjects . 

It should be specified that this paper does not report data to the 
end of providing validation information. At this point in its de- 
velopment, the S.O.R.T.S. measure is being used to explore the use- 
fulness of the approach and the kinds of information obtainable. 
Later studies will attempt to provide indices of validity and relia- 
bility for the factors being discussed. 

It is also clear that training young handicapped children to 
organize material improves their ability to deal with large sets of 
stimuli (20, in this case) planfully, and that such training 
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facilitates more efficient recall. The data in support of this 
conclusion are clear; the number of children who did not generate 
a functional strategy for grouping decrease markedly following 
training. In Study 1, for example, children in this category 
descreased from 13 to 2 on sort 3 (Table 2), and from 7 to 2 in 
Sort 1 of study 2 (Table 7) . Children also increased in the use 
of strategies making use of meaningful associations between items 
(as opposed to attending to irrelevant color attributes). Sorts 1 
and 2 of study 1, for example, show an increase of seven subjects 
finding associative relations (Table 2) Sorts 1 and 3 of study 2 
shows a like increase of four cases employing functional grouping 
strategies .Table 7) . 

Recall data, too, are strong indicators of the usefulness of 
this approach. Study 1 children increased in mean recall by nearly 
two items (Table 4), with an increase of 11 subjects (more than one 
third) recalling nine or more. Subjects in the experimental group 
of study 2 also gained in the number recalling 9 or more items, with 
six cases (nearly one half) showing this increase. This is contrasted 
with no change in the control group (Table 8) , indicating support for 
the efficacy of the training sequence. That such changes in recall 
are accompanied by changes in the grouping strategies employed by 
the subjects suggests support for our hypothesis that organizational 
processes at input are related to recall effectiveness. Further 
support for this hypothesis may be found in the clustering data. 
Because it is based on the extent of agreement between items grouped 
at input and items grouped at recall, we take this score to be an 
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index of the extent to which the groupings formed at input 
facilitate (and render more efficient) the subject’s recall. 

There are strong indications that in fact such a relationship 
exists. For example, all but two of the subjects in study 1 
who cluste: ed significantly recalled 9 or more items, while 
the other two recalled 8. All subjects who clustered in study 2 
recalled 9 or more items. In spite of the sample sizes and the 
relatively s lort intervention period, the trends observed in all 
three indices are quite strong, and suggest further exploration 
of the appro ich . 

It would appear from the pilot data cn sort 4 that the 
differences :'.n children’s ability to discover and utilize organi- 
zation imposed on material by the experimenter may be specified. 
Differences on the kind of associations found in the materials are 
consistently related to differences in both recall (Table 10) and 
clustering (Table 11) . Children who could identify functional reasons 
for the groups presented recalled more of the items and clustered 
them more than those who could not. This finding suggests that 
training in the use of organizational strategies also facilitates 
the use (for mnemonic purposes) of organization supplied by an 
adult. Such a notion would support the concept that organizing 
teaching may be useful for young EMR children, and that teaching 
such children how to use the organization supplied would be even 
more helpful. The results of these studies would support both che 
efficacy and usefulness of a strategies approach to teaching. It 
would be possible, if the observed changes in organizational abilities 
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transfer , for the child to learn material presented in an organized 
manner more effectively, and to generate a strategy for organizing 
otherwise unassociated material. Such a possibility, as suggested 
by these data, would imply much benefit to the consideration of 
revised curricula incorporating direct training in the use oi stra- 
tegies for teaming, rather than the emphasis typically found in 
special classes on perceptual processing and repetitive presentation 
of subject- natter content. 

From the studies run, the S.O.R.T.S. test is sensitive to 
changes in organizational skills in children up to a chronological 
age of 9 years. The promising results of the two pilot studies 
provide impetus for further testing and the collection of normative 
data on how young children organize sets of pictures. The informa- 
tion available through this kind of testing may provide us with 
rich data concerning how children process information. Further, tha 
differences in learning abilities between young EMR and young "normal” 
children may become more apparent, enhancing the development of more 
functional cognitive interventions. To date there is a rapidly 
growing body of subjective evidence from teachers in the classroom 
and from observations cf the writer and his colleagues, that the 
test has good face validity, and is reliable. Interscorer reliabilities 
are strong (all in the .89 to .94 range), suggesting that the criteria for 
assigning scores to the groupings made by the subjects are reasonably 
objectified. Current studies will include data on reliability 
between examiners and on test-retest stability. 

While there are still numerous problems with the measure to be 
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accounted for (e.g., the need for an alternate form, for validity 
measures and the like) , our preliminary analyses show it to be a 
useful tool in the diagnosis of information processing difficulties 
in young children. It further provides us with a new perspective 
on the planning and development of educational intervention techniques. 
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1'i t'ure 1 

Histogram showing frequencies of scores representing 
no functional strategy for grouping (A), perceptual 
groupings (R) and associative groupings (C) for pre- 
and post- test data, Sorts 1-3. 
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Means, standard deviations and t scores for 
pretest and posttest data; surfs 1-3. 
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Table 2 



I’requencies of subjects showing no functional 
strategy (A) , perceptual groupings (B) and 
associative groupings (C) for sorts 1-3. 
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Table 3 



Subjects recalling a. each level; sort 3. 



Pretest Posttest 
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Tab lc 4 



Means, standard deviations aid t scores 
for recall data; sort 3. 
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Table 5 



Frequency of clustering at .05 level 
( Z > 1.96) 



Pretest Posttest 



No clustering 



Clustering 
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Table 6 



Study 2 means, standard deviations and t scores 
for experimental (K) and control (C) subjects; 

sorts 1 - 3. 
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Tabic 7 



Study 2 frequencies for E and C groups showing 
no functional strategy (A), perceptual groupings 
(B) and associative groupings (C) ; sorts 1 - 3. 
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Table 8 



Study 2 subjects recalling at each 
level; sort 3. 



Experimental 

group 



Control 

group 
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Table 9 



Pretest no 
clustering 

Clustering 



Posttest no 
clus tering 



Study 2 frequency of clustering beyond 
.05 level of significance; sort 3. 
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Table 10 



Study 2 subjects identifying no relaiions (A), perceptual 
relations (B) and associative relations (C) between items 





in experimenter- 
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Table 11 



Study 2 recall and clustering in sort 4 
for experimental and control groups. 
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APPENDIX A 



SORTS Administration 

Order The first and second sorts involve manipulation of the same, 
set of stimulus cards. The third sort requires a different set. The 
cards are numbered onthe back for order of presentation, and should 
be sequenced numerically for each administration. Thus the cards for 
sort 1 vhould be reordered prior to presentation for the second sort. 
The cards usee in sort 3 are again uso.d in sort 4, but the experimenter 
sorts them instead of the child. 



Array — Sorts 1 and 2 are to be arranged in a circle, with each numbered 
card placed ir, its corresponding position on the fact, of a clock. That 
is, card #1 (alligator) goes in the 1:00 o'clock position from the child's 

perspective, card #2 in the 2 o’clock position, and so on clockwise to 

12 . 

The third, or test, sort is arranged in four rows of five cards 
each, moving from left to right and from top to bottom. Sort 4 is 
arranged by E in five rows of four cards each, corresponding to the 
categories specified on the scoring sheet. 



Seating — The experimenter should sit at a right angle to the subject, 
with his scoring sheet on a clipboard. The scoring sheet should not be 
visible to the child, although its contents are not meant to be a 
secret should an inquisitive child ask. Stimulus cards which are not 
currently in use should be out of the subject's sight. 
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4. Familiarity — Prior to administration of the SORTS, the experimenter 
should have memorized the matrices for recording specific groups. He 
should know which color group corresponds to which row on . i matrix 
and which category corresponds to which column. 

Memorization of the specific instructional protocol is essential, 
as well as facility with alternative directions. 

5. Prompting — (A). Names. Should a subject not be able to name a 
stimulus card, the experimenter should supply the name and have the 
subject repeat that name before the next card is displayed. 

If the subject gives a name for a card which also applies to 
another of the stimulus cards, the name should be corrected, and the 
subject should repeat the corrected name. Example: if 'owl* is 

called ’bird’, the experimenter should say, "Let’s call this an ’owl’. 
What is this?" (Subject response: ’owl’). Thus the experimenter 
must insure that no two stimulus cards in the same sort are given the 
same name. 

Inappropriate Names (such as ’cat’ for lion or ’dragon’ for alli~ 
gator) are admissible, but should be noted in the matrix beside the 
corresponding name. 

(B) . Sorts. One (and only one) prompt is allowable in demonstra- 
ting what is meant by putting things together in piles. This should 
be used only if it is evident that the subject does not understand what 
he is to do. It should be done only with the duck (card #3) and only on 
the first sort. And it should be done in the following way: Allow 15 
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seconds for sc inning before determining; that the subject will not 
group the card-;. If he still doesn't seem to understand, prompt: 

Move the luck to the right of the configuration and say: 

"See this picture? See if you can find some other ones 
that go with it." 

Again, this ma^ be done only on the above conditions. 

(C) . Reasons. If the reasons a child gives for his groupings 
are so ambiguous as to give little insight : nto his meaning, say: 

"Tell me more about that." Example situations: initial reason is 

'they're the same", "they look alike", or ".hey go together." 

6. Clinical Latitude — Reared number 4 above concerning familiarity. 

It is suggested that the directions be given verbatim, but modification 
of the wording is permissible at the experimenter's discretion in 
eliciting individual children's grouping responses. Rapport with 
the subject should be established prior to the beginning of the test 
rather than during the testing situation. 
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S.O«R.T.S. SCORING S.ILET 



Name 



Age M / F Date: 

Examiner 



Sort 1 





(1 and) 


(water) 


(air) 


(red) 


DOG 


ALLIGATOR 


BIRD 


(white) 


COW 


FISH 


TURKEY 


(blue) 


SQUIRREL 


SEAL 


OWL 


(yellow) 


LION 


FROG 


DUCK 


Reasons : 




Comments: 





1 . 

2 . 

3. 

4 . 

5. 

6 . 



Centering? 


Syncretic? 


Post-hoc reasons'? 


Difficulty understanding? 


Y / N 


Y / N 


Y / N 


Y / N 


Sort 2 




(land) 


(water) 


(air) 


(red) 


DOG 


ALLIGATOR 


BIRD 


(whi te) 


COW 


FISH 


TURKEY 


(blue) 


SQUIRREL 


SEAL 


OWL 


(yellow) 


LION 


FROG 


DUCK 


Reasons : 




Comments: 





1 . 

2 . 

3. 

4. 

5. 
5 . 




Post-hoc reasons? 
i / N 




Difficulty understanding? 
Y / N 



Centering? 
Y / N 



Syncretic? 
Y / N 



S.O.R.T.S. page 2 NAME 



Sor t 3 














(grow) 


(noise) 


(f urni Lure) 


(transport a ti on) 


(abodes ) 


(red) 


FLOWER 


HORN 


DESK 


BOAT 


TEEPEE 


(white) 


LEAF 


WHISTLE 


TABLE 


PLANE 


BIRDHOUSE 


(blue) 


BANANA 


DRUM 


CHAIR 


BUS 


BARN 


(yellow) 


CORN 


BELL 


BED 


BIKE 


HOUSE 


Recall t 


(include 


all responses in 


order) 






1 . 






11. 






2. 






12. 






3. 






13. 






4. 






14. 






5 . 






15. 






6. 






16. 






7. 






17. 






8. 






18. 






9. 






19. 






10. 






20. 






Reasons : 






Comments : 







1 . 

2 . 

3. 

4. 
3. 
6 . 

7. 

8 . 

9. 

10 . 



Centering? Syncretic? Post-hoc reasons? Difficulty understanding? 

Y/ N Y / N Y / N Y / N 




S3 



S.O.R.T.S. Scoring Sheet: Page 3 NAME 



Reasons for constrained (experimenter’s groups: 



1. (grow) 

2. (noise) 

3. (furniture) 

4. (vehicles)_ 

5. (habitats)_ 

RECALL // 2: 

1 . 

2 . 

3. 

4. 

3 . 

6 . _____ 

7. 

8 . 

9. 

10 . 



11 . 

12 . 

13. 

14. 

15. 

16. 

17. 

18. 

19. 

20 . 



Comments : 
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S.O.R.T.S. CODIMG KEY 



In seeing the sorts mode by children, the following criteria 
for assigning levels to each group are to be followed. Each group 
made Is to >e coded with two numbers: the first number corresponds 

to the code 1 level appropriate to the type of sort the child made, 
and tin. sec md number indicates the number of items the child put 
into that g'oup. * 



Thus, ..f the child put three red animals together in one group 
and gave as a reason, "because they're the same color", his coded 
score for that group would be 2 3 (the 2 indicating a level 2, 

or perceptual group, and the 3 indicating three items in the group) 

Three : actors must be taken into account in determining the 
level for e; ch group: 

1) the actiul group made, indicated by tha numbers in the sorting 
matrix. 

2) the reason given by the child for that particular group, 

3) the examiner's judgment as to the child's reasons, as indicated 
m his marking of syncretic or post-hoc reasons, and in his 
written comments, if different from th i child's stated reasons. 

Genearlly , should a discrepancy arise between these three 
factors, greater weight is given to the combination of the S's 
actual group and the E's judgments, rather than relying on possibly 
imprecise verbal reports of the S. 



The numbers in the column on the left of the page indicate the 
level to be assigned items in groups corresponding to reasons based 
on the criteria specified in the text on the right. In case of a 
clear discrepancy of more than one level on any given group, which 
cannot be resolved by a specifiable criterion on the coding key, a 
compromise to the level between the two levels which are discrepant 
is appropriate. But this composmise should be noted for subsequent 
interrater discussion. 



1 



S.O.R.T.S. CODING KEY 
LEVELS 



1 

1 

1 

1 



1 

2 

2 

2 

2 



3 

3 

3 

3 



3 

3 



No strategy apparent (syncretic) 

all cards in one or two groups, with no reasons 

Caids grouped by spatial contiguity 

Made design (e.g., put cards in form of letter E) 

Inferred no strategy, based on far-fetched reasons and lack of 
correspondence with actual group made (often this is the case 
with post— hoc reasons) 

Sort based on color differences 

Sort based on color similarities 

Sort based on phonetic similarities 

Sort be sed on shape of card 

Disjunction, either related or unrelated, but treated separately 
as in centering (e.g., "this one has and this one has 

Posture 1: they are both sitting. 

Shape of the item (e.g., they are both long) 

Edge matching each item to the one next to it by association, 
but with no association for the group as a whole. 

They have (noun) (e.„. , legs, mouth, etc.) 

They _Jyc rb) (e.g., fly, walk, etc.) IN PAIRS. 

Ovennclusive groups (e.g., 8 items in group called 'animals 1 ) 

Multiple groupings: "these two in water, these two swim," 

but with no connection between groups. 

Idiosyncratic associations: (e.g., drum with teepee, bicycle with 

bell, birdhouse with leaf...) 

They . could be (pets, toys, etc..., implying idiosyncratic label). 

Two items by location with one dvsjunctive (inappropriate) in a 
group of three items (e.g., these two are in the jungle, and 
there is also a seal) 



*') 



ERJC 

imiflaffffifiiaaa 



56 



S.O.K.T.S. COD I NC Ki:v : 



levels continued 



* 



4 Key ring: Severn] items go together because thov are nil 

associated with one item within the group (e.g., 'these go 
in the house') 

4 Association by location IN PAIRS (if identif ieatorv) 

4 Association by function IN PAIRS 

4 Ca egorical group, but including one or two items which don't 
fit the category 

4 They (v erb) , with THREE OR MORE in group 

4 They are made of (material), (if appropriate). 

5 Association by location (excepting key rings), with three or 
more i tarns in the group. 

5 Association by function, with THREE CR MORE in group 

5 Categorization (e.g., these are furniture) 

5 They are (label) (e. g. , food), even by pairs. 
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